TAPE: Task-Agnostic Prior Embedding for Image Restoration

نویسندگان

چکیده

Learning a generalized prior for natural image restoration is an important yet challenging task. Early methods mostly involved handcrafted priors including normalized sparsity, $$\ell _0$$ gradients, dark channel priors, etc. Recently, deep neural networks have been used to learn various but do not guarantee generalize. In this paper, we propose novel approach that embeds task-agnostic into transformer. Our approach, named Task-Agnostic Prior Embedding (TAPE), consists of two stages, namely, pre-training and task-specific fine-tuning, where the first stage knowledge about images transformer second extracts assist downstream restoration. Experiments on types degradation validate effectiveness TAPE. The performance in terms PSNR improved by as much 1.45 dB even outperforms algorithms. More importantly, TAPE shows ability disentangling from degraded images, which enjoys favorable transfer unknown tasks.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Algorithm-Induced Prior for Image Restoration

This paper studies a type of image priors that are constructed implicitly through the alternating direction method of multiplier (ADMM) algorithm, called the algorithm-induced prior. Different from classical image priors which are defined before running the reconstruction algorithm, algorithm-induced priors are defined by the denoising procedure used to replace one of the two modules in the ADM...

متن کامل

Efficient Digital Image Restoration for Analog Video Tape Archives

This paper introduces a research project, which addresses problems associated with the image restoration process for digitization and archiving of analog video tapes. The goal of this work is the development of a new model of image restoration and its application to real video sequences. This research will focus primarily upon the digital imaging and restoration process chain; its main thrust w...

متن کامل

Learning-Based Image Restoration for Compressed Image through Neighboring Embedding

In this paper, we propose a novel learning-based image restoration scheme for compressed images by suppressing compression artifacts and recovering high frequency components with the priors learned from a training set of natural images. Specifically, Deblocking is performed to alleviate the blocking artifacts. Moreover, consistency of the primitives is enhanced by estimating the high frequency ...

متن کامل

Image Restoration via Multi-prior Collaboration

This paper proposes a novel multi-prior collaboration framework for image restoration. Different from traditional non-reference image restoration methods, a big reference image set is adopted to provide the references and predictions of different popular prior models and accordingly further guide the subsequent multi-prior collaboration. In particular, the collaboration of multi-prior models is...

متن کامل

Denoising Prior Driven Deep Neural Network for Image Restoration

Deep neural networks (DNNs) have shown very promising results for various image restoration (IR) tasks. However, the design of network architectures remains a major challenging for achieving further improvements. While most existing DNN-based methods solve the IR problems by directly mapping low quality images to desirable high-quality images, the observation models characterizing the image deg...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2022

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-031-19797-0_26